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ABSTRACT 

Policy-impact analysis is introduced as a m 
aid higher education in dealing vith the significant proble 
decade of the 1960s. The model provides a framework within 
variety of futures research techniques are tied to policy 
development, implementation, and evaluation. The utility o£ 
is that it structures communication between those developin 
information about the future and those responsible for poll 
formulation and decision-making in such a fashion that poll 
can choose among alternative policies based upon the probab 
of each. There are four stages in the policy impact model: 
monitoring, forecasting, goal setting, and policy analysis 
implementation. Monitoring and forecasting perform the role 
organizing, structuring, and articulating images of the fut 
respect to a particular set of assumptions and indicators, 
stage of the model, goal setting, revolves around the proce 
setting realistic goals given the information provided in t 
two stages* This stage requires the generation a desiraD 
in a procedure much like that of forecasting using the deip 
The first three stages serve to identify specific trends^ t 
which may affect those trenis, and the goals of the organiz 
the final stage, the resear::h staff estimates how a particu 
may affect a given trend through influencing the probabilit 
occurrence of one or more s-r^ecified events affecting the tr 
the selected policies are iplemented, the process of monit 
begins anew, thereby enabl: ? the staff to evaluate the eff 
of the policies by compari' actual impacts with those fore 
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^olicy-ImpacL A-al' i- R- - -onal M-thod zo Respond 

to the C.-ial^enge- : . ■ Hiner IducatiDn m -he Eighties 

There ^re a nu;v,c m : z : .gnif i problems facing higher 

education i the c voa-- -he ei :J,':.-_es . F-ancial support for 
the enter 36 is, , er -ps, che m. -.: pressing problem. For ex- 
ample, at .-esent inf ■-3^ :onary loss-s are a- araging fourteen 
percer.t u r year, u . th .-evenues grrv_ng at c- ly seven percent 
per year a fsct wr.i i £ :c -.tinue. chrough he Bcade, will 

leave cd ■ -sr an..'', ur.-vc sxtx'.is < It: one-hal.: the revenues (in 

real terr iy ..cw rsT-- (De i,e , Fur-': -rmore , given 

current con~..ic d ^' r f ic^ Ities of :--e country as a whole, edu:;a- 
tion, ai d partic, -ir: v l igher educaticn, has nc strong claim tr 
extra fundin b ■ ra . .-v ^-.ta-e r- ■ -^nment ndeed, there 

is increasir: ' .^-ce -f a- Vc ,ar:r . cur-_, ..vernment spei 
ing, cr where : ' is .z^reased s:v>.-.:_rng , i- — ::ears that it 
will be for strer .-hen-iur ou" natic.ia.. defense .oc education. 
Too, grven tr- d-cl-nin- pet.enrag.- parents ■ i rh college age 
children, tl- ^ rn-r=Bs -d aginr of tr -r American popu-_ation, and 
the fact thrt c^Hrrreticnary income for U.S. househ.lds has de- 
cline- markedly ..nc^u =72, the pirriic's c-bility t- support 
higher educario: ■ --r ^trib.urions r axes and increased tuition 

has dlso dec 1 in-. 

Such financial f oble.^; are .compounded when on. examines 
demographic projecric.ir Df "he normal college-goir- age cohort. 
For example, it is . • imat. : that the cohort of lS-24 year olds 
in this country will cvcrr. . some 15% (or 2,6 million) during 
this decade (Johansen -r.r ^Nauity, 19771 . This decline un- 
doubtedly will affect enrcrlment in higher education since 



forty-eight percent of the total enrollment (and 64% of the 
undergraduate enrollment) came from this age cohort in 1975. 
Given the projected decline in financial aid available to stu- 
dents, one could anticipate further reductions in enrollment. 
Such problems are attentuated by a growing perception in our 
society that a college degree no longer has the value it once 
had, i.e., that individuals with vocational and technical train- 
ing can obtain better paying jobs than people with baccalaureate 
or professional degrees. This perception is enhanced by the 
fact that "underemployment" is increasing, i.e., the propor- 
tion of female college graduates who have settled for non-pro- 
fessional employment has increased four-fold, and the propor- 
tion of men, three-fold, during the last 15 years. Indeed, the 
U.S. Bureau of Labor Statistics projects a "surplus" of college 
graduates reaching 140,000 annually by 1985 (Dede, 1981). 

Many of these problems have been present in higher education 
during the 70' s, as noted in much of the literature of the field 
which focused on maintaining a "steady state." The 70 's saw 
another phenomenon related to the state of the economy, that 
is, the declf-'.e £ raculty mobility in the academic marketplace. 
This declinf- '-..i^d ^nto a concomitant problem in the 80 's, 

i.e., the " ter.u: ius, -in" of college faculties. Consequently, it 
is difficult to Introduce "new blood" in the form of energetic, 
highly trained, young doctorates of all races, sexes, and creeds, 
Thus there is concern of academic stagnation on many of our cam- 
puses, and a good deal of agitation with re^apect to the problem 
of under-representation of women and minorities on college and 
university faculties. 
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Along with the projected decline of enrollirtents of trad .ijr^ 
ally-aged college youth, is an accompanying change in the c 
sition of the college student population, in that -.here -.re 
creasing numbers of over-35 year old adults, minors -ies, 
women. This changing mix of -.ne student population with 
panying demands for innovative- pedagogical strategies as v . a. 5 
for changing the curriculum, and even changing the ime a' , ^ ct: 
curriculum is offered (evenings and w^ekencs) , will in tu 
create additional administrative problems an college carr,:DU 

In sum, then, the decade of the 80 's promises tc be or f 
challenge and uncertainty for the country as a whole, ana r 
higher education in particular. The challenge of the 8( w/if 1 
be to develop policies to cope with the problems, some cf cr.- 
are outlined above, and still maintain quality education, 
education of the type which the citizens of- this country ^ee' 
in order to meet the demands of a complex, increasingly t 
logical, and somewhat unstable world. 

The purpose of this paper is to introduce a model for 
oping and assessing policies in the face of these challervf^^ , 
This model, the policy-impact analysis model, provides a 
work within which a variety of futures research technique e 
tied to policy development, implementation, and evaluati: 
The utility of the model is that it structures conmunica . 
between those developing information about the future anc : jse 
responsible for policy formulation and decision-inaking i: ^ .n 
a fashion that policy-makers can choose among altziernativ^ p:^ i- 
cies based upon the probable impact of each. 
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icy-Impact Analysis Model 

T are -ages in the policy-impact analysis niodel: 

>rnit : "ng / i^-' •.-.::i^ng/ goal se::ing, and ooliry analyses & im- 
.ame n-irri jr :.rDring refers zo the ide: li . ication i.nd 

.ec :i. e' of concern eitaer t: po.-ic makers :r scho- 

rs - :r if entering fr eshmen enrol_-.::-ents ' liberal 

_z"S prc~ - -e^ar to be declini::ig, unive— _ i. c: ^ Is may 

?3a ^' - -r :nis issue as opropriate f :-ind 
; ^ibl£ V second stage of the mcde^, io^ casting, 

v-2lves ' si: a-riety of futures research teihir 7U£5£ ^o 

foracas ne able future for selected issuer, ow speci- 

fi i as 1 ii " rs (or variables), e.g., liberal i^ts an- 
rc^lmer.-L 'I . rasponse to the projected trends of inc icators 

in thes- -ij-ear policy makers then establish gcais, the third 
stage of -r.e rr b1 . For example, using the fur^^res research 
trcrhniqi* es desc ibed below, it is projected ^hat liberal arts 
.^i^ri^^grair;^ will -/.perience decreasing enrollmerrs . State system 
^i^rvel V. -.versi y officials, upon receiving ttiis information, may 
- a acc to esra±)lish goals for increasing ('^ r maintaining) en- 
: lmen:rs in liberal arts programs. This le^s to the fourth 
^H-4e ci the model, the analysis and implemer.cation of poli- 
tc achieve those ends. In this stage, ^ variety of 
ibla policies are analyzed in order to dei-^rmine their 
proi^ble impact, and are ranked on those chara 'J;ieristics deemed 
inper'tant, e.g., relative costs versus benefits- Those policies 
r^nkec at the top are then itiiplemented^ E\?:aluai::iOD .occurs when 
the stiages of the model are repeated using additional analyses 



and further refinement.: This model ill be deseribe:. -nd il- 
lustrated in more de ~ ._i below. 
Stage I: Mcr.itorinc 

■ 'ionitc "i: g consi . of first iciintifying areas fo- ady 
then, in junction . -h decision- akers, selecting 'c . --oprL- 
ate indica. . jrs of th . - issues of c ricern, and, finall using 
a d^ a b.^s of educa::i>:.or. ./social ir.dicacors, develop:.- g e.nd 
plo* r.i_storical rat: easuring uhose indicators- -:^~re are 

conr^ "<'^ ^-'cs in this :r ^. s. Primary among these is tne avail- 
abi-^ jf an adequate dx— a base which enables the research 
st^r T measure indicairors over time- This means the: in order 
fc -h . raff to illus~?.*e trends from these data in, for exam- 
pi f_ year time ir aents, data must be available for at 
ie t: t. ^ last 5-10 y J- For example, if the staff wishes 
tc^ ; oreaast the trend ' student enrollment for the next five 
ye s, enrollment dat-i over the past 5-10 years must be avail- 

Furthermore, t t^r staff must ascertain that these data are 
oz reasonable reliability and validity. 
Stage II: Forecasting 

There v.re a variety of forecasting methods, ranging from 
"implicit" forecasts of the trends discussed in stage one, to 
"explicit" forecasting involving mathematical trend extrapola- 
tion, judgmental trend extrapolation, and probabilistic extra- 
polation . ^ 

Implicit forecasting is the oldest forecasting technique, 
and simply involves viewing the historical data to ascertain 
the trend, (e.g., enrollment rates since World War II using 
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five year increments) . This method of forecrasring assumes -r.at 
those forces shaping recent developments of the trend, irrespec- 
tive of what they are and how they operate, will continue zo 
affect the trend in the same fashion in the future. Although 
this assumption is often valid, particularl zjr those trends 
which have a. long and stable history, and v;r:„ h may not be sub- 
ject to sudden changes, we know that in man* nstances tri.£; 
assumption does not hold, particularly in c^. ^ • pidly changing, 
complex society. 

Explicit forecasting refers to trend e-:n:rapolation , i.e., 
an extension of the recent course of develcrpr an cs with respect 
to a particular trend. There are two has : -lechniques in this 
method, mathematical and judgmental • Mat ernatical methoc s range 
from algebraic equations developed throuc . regression ane.lyses 
to more complex systems models. Such metnods enable one to 
mathematically develop a "fit" with historical data and then 
extrapolate the trend line into the future to generate the 
forecast . 

The judgmental method of explicit forecasting uses expert 

forecasting and/or the delphi technique* Expert forecasting is 

accomplished by requesting experts in the field to forecast a 

trend based upon the data base and upon their best estimates 

of changes in the likely future. The delphi technique is a 

method whereby the combined forecasts of a group of experts are 

used in an attempt to describe the future relevant to that 

trend. This combined forecast is then presented to the same or 

another group of experts for refinement and additional consider- 
3 

ations . 



A major ass- "tion of both implicit and explicit forecast- 
ing methods i -t those forces which have shaped the histori- 
cal developme a trend will continue to guide developments 
of this trend ihe future. These methods tend to ignore "sur- 
prise" davel^"---3 which will affect the trend. 

P robabil-s-r forecasting , on the other hand, combines mathe- 
matical and :_dgmental methods, and includes "surprise" events 
which might occur in che future and, therefore, affect the trend. 
This technique requires first the development of an extrapola- 
tive forecas- of a trend, then the identification of surprise 
events which could affect the trend, a concurrent judgmental 
evaluation -f the impacts of these events on the trend, and, 
finally, through use of the computer and Monte Carlo or similar 
routines, calculating the probabilistic forecast that trend. 

Stage III: Goal Setting 

The first two stages of a policy-impact analysis model, moni- 
toring and forecasting, perform the role of organizing, struc- 
turing, and articulating images of the future with respect to 
a particular set of assumptions and indicators. The next stage 
of the model, goal setting, revolves around the process of set- 
ting realistic goals given the information provided in the first 
two stages of the model. This stage requires the generation of 
a "desirable" future in a procedure much like that of forecast- 
ing using the delphi method. This process may involve educa- 
tional experts, as well as authorities from business, industry, 
public interest groups, and government. The rationale for 
this stage is based upon the importance of having a concept of 
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the desirable future with respect to a particular issue in order 
to develop policies designed to achieve this future. 
Stage IV: Policy Analysis and Implementation 

The first three stages of this model serve to identify spe- 
cific trends, the events which may affect those crends, and the 
goals of the organization. As such, these steps specify policy 
options and responses. In the final stage the researc'i staff 
estimates how a particular policy may impact a given trend 
through influencing the probability of the occurrence of one or 
more specified events affecting the trend. 

To briefly illustrate, suppose that the policy issue being 
studied is enrollment in liberal arts baccalaureate programs, 
and that measurements of those enrollments have been made since 
1945 and are part of the data base available to a research study 
team. Furthermore, assume that those enrollments were forecast 
to decrease over the next 10 years, although the desired future 
would be one in which they would remain the same or increase. 
In this stage of the model the team would first identify those 
events which could affect enrollments adversely, e.g., infla- 
tion, tho decrease in the size of the traditional-age cohort, 
curtailed federally funded financial aid, decreased federal and 
private financial support, and an increasing social perception 
that vocational-technical training is of more value than liberal 
arts education with a corresponding decline in the value of a 
liberal arts degree. The team would also identify events which 
could positively affect enrollments, e.g., an increasing tendency 
for mid-career shifts due to a rapidly changing technological 
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society in which opportunities for new occupational careers beco.T\e 
available at a much more rapid rate than before, or the increas- 
ing tendency for major corporations to sponsor continuing pro- 
fessional education programs for their employees. Such events 
may positively affect enrollments because a widely held assump- 
tion of liberal arts education is that it facilitates the de- 
velopment of thinking and communication skills easily transla- 
table to a wide variety of occupational skill requirements - 

The next step in this process would be to identify possible 
policies which could affect those events (or which could affect 
enrollments directly) For example, policies could be designed 
to increase enrollments by aggressively pursuing marketing stra- 
tegies which laud the value of a liberal arts , education as es- 
sential preparation for later occupational training. This stra- 
tegy could be undertaken with secondary school counselors and 
students, as well as with first and second year undergraduates 
and their advisors. Too, graduate and professional school fac- 
ulty could be encouraged to consider adopting and publically 
announcing admissions policies which grant preferential consid- 
eration to liberal arts graduates. Another policy could be to 
form coalitior with higher education organizations in other 
geopolitical areas to press for increase federal aid to students 
as Weill as to institutions. With respect to the potential market 
in the business, industrial, and civil service spheres, poli- 
cies with respect to establishing joint programs to provide lib- 
eral arts education on a part-time or "special" semester basis 
could be designed and implemented. 
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Policies could also be designed to maintain enrollments with- 
in the current student population. B'or example, one policy could 
concern an "early warning" system to identify students who may be 
just entering academic difficulty. Others could be designed to 
inhibit attrition through improving the quality of the education- 
al environment. Such policies would involve establishing facul- 
ty and instructional development programs, improving student 
personnel services, etc. 

Of course, implementation of specific policies can affect 
the probabilities of events, i.e., they can make them more or 
less likely to occur. Too, events can interact with each other 
to affect specific trends. Consequently, a policy might affect 
several events, thereby changing the probabilities of their im- 
pacts on each other and on the trend of concern, undergraduate 
;.;.v. ral ?.rts enrollment. Such interactions between policies and 

- s may be categorized in a pel icy-to-events impact matrix, 
a urix which enables the staff to generate new estimates of 
the probabilities and impacts of those events modified by the 
policies. These estimates are calculated on the basis of mul- 
tiple conditional probabilities in the computer routines cited 
earlier in the discussion of probabilistic forecasting. The end 
result of this somewhat complex activity is a policy-impacted 
forecast for undergraduate baccalaureate programs given the im- 
plementation of specific policies designed to improve enroll- 
ments directly, or indirectly by impacting on those events which 
in turn affect enrollments. Thus competing policy options may 
be evaluated by identifying those policies with the most favor- 
able cost-benefit ratio, those having the most desirable effect. 
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the most acceptable trade-offs, etc. 

Discussion 

Evaluation occurs when the policy-impact analysis -model is 
iterated.* That is, when the selected policies are implemented, 
the process of monitoring begins anew, thereby enabling the staff 
to evaluate the effectiveness of the policies by comparing actual 
impacts with those forecasted. This requires that a data base of 
social/educational indicators be up-dated and maintained in order 
to evaluate the forecasts and policies and to add new trends as 
thoy are identified as being important in improving education in 
the future. Implementation of this model also requires that new 
and old events be re-evaluated, and that probabilistic forecasts 
be up-dated in order to enable goals to be refined and re-evalu- 
ated. This activity leads to the development of new or re-eval- 
uated old policies/ which in turn, enables the staff to up-date 
policy-impacted forecasts . 

It should be noted that the futures research techniques de- 
scribed here, particularly the probabilistic forecasting methods, 
have been developed only within the last decade or so, and have 
been used primarily in business and industry, with mixed results. 
The efficacy of these techniques is dependent upon the ability 
of the staff to (1) identify those events which may affect a 
trend directly or indirectly, (2) accurately assign subjective 
probabilities to those events, and (3) design and obtain a re- 
liable and valid data base of social/educational indicators. 
The efficacy of the policy-impact analysis model is dependent 
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upon the close interaction of the staff and decision-makers with- 
in each stage of the model. 

However, given these requirements, conditions, and limita- 
tions, the model uses the most advanced technology available in 
contemporary social science in a rational approach to provide 
policy makers more reliable information about possible futures, 
and how to use that information to achieve a more desirable fu- 
ture. Given the challenges facing higher education in the eigh- 
ties, scholars and policy-makers in the higher education commun- 
ity are well advised to explore this approach to formulating and 
implementing policy at the institutional, state, and regional 
levels. 
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B'ootnotes 

■""This presentation is based upon recent articles by Renfro (1980) 
and Morrison (forthcoming) . For a reprint of the Renfro articler 
v/rite Dr. William L. Renfro, President, Policy Analysis Co., Inc., 
148 E Street, S.E., Washington, D.C. 20003. For a copy of the 
proceedings which contains the Morrison article, write Dr. 
Bernice Willis, Southeastern Regional Council for Educational 
Improvement, PO Box 12746, Research Tr:iangle Park, NC, 27709 . 
^For a detailed description of various forecasting techniques 
see Allen (1578), Alter (1979), Amara (1972), Armstrong (1978), 
Enzer (1976), Ewing (1979), Fowles (1976), Gordon and Stover 
tl976), Lipinski and Tydeman (1979), and Martino (1972). 
^For a detailed description of the delphi technique, see Linstone 
and Turof f (1975) . 

"^One should note that Monte Carlo routines tend to require large 
computers and many computer runs, and, therefore, are somewhat 
expensive to use. Several agencies have developed computer pro- 
grams which approximate the Monte Carlo method and are more ef- 
ficient. For eixample, the Futures Group (76 Eastern Boulevard, 
Glastonbury, Connecticut 0o*033) has developed a computer soft- 
ware package for trend-impact analysis (FUTURESCAN) , and the 
Center for Futures Research, Graduate School of Business Admin- 
istration, at University of Southern California (Los- Angeles , 
California 90007) has developed a software package for cross- 
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impact analysis (INTERAX) • Both packages enable the user to 
engage in probabilistic forecasting. 

Of course, there are events over which educational decision- 
makers have absolutely no control, e.g*, inflation and the size 
of the traditional -age cohort. 



